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Abstract 

To analyze the stability of Ito stochastic differential equations with multiplicative noise, we 
introduce the stochastic logarithmic norm. The logarithmic norm was originally introduced by 
G. Dahlquist in 1958 as a tool to study the growth of solutions to ordinary differential equations 
and for estimating the error growth in discretization methods for their approximate solutions. 
We extend the concept to the stability analysis of Ito stochastic differential equations with 
multiplicative noise. Stability estimates for linear Ito SDEs using the one, two and oo-norms in 
the l-ih mean, where 1 < I < oo, are derived and the application of the stochastic logarithmic 
norm is illustrated with examples. 
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1. Introduction 

For A E C"^" and X{t) £ C", we consider the ordinary differential equation (ODE) 
dXt ^ AXtdt,X{0) = xo- Then we have \\X{t)\\ < ||a;o||e'"(^)* where iJ,{A) is the logarith- 
mic norm of the matrix A [4,19,20]. If fJ.{A) < 0, then the ODE is asymptotically stable. 
Also, ^J'{A) using the matrix 2-norm gives an estimate [13] for the pseudospectrum [15] 
of A: max3?Ae(A) — e < fi{A) where 1 e > 0. Since the pseudospectrum captures the 
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stability of the numerical solution of the ODE over a finite number of time steps under 
the effect of local stiffness and nonnormality of A (we shall refer to this as the numerical 
stability) [6,7], having fJ.{A) < implies numerical stability in addition to the asymptotic 
stability of the ODE. As is already shown in [6] , transient numerical stability affects the 
computation and choice of methods for numerical integration of the ODE. 

In this paper we extend the classical logarithmic norm to the stability analysis of Ito 
stochastic differential equations (SDE) and introduce the stochastic logarithmic norm for 
estimating the numerical stability of an SDE in order to facilitate the selection of stiff 
and balanced stochastic numerical integration schemes. Letting A, B G C"^",X(<) S 
C", i? g C"^", the Ito SDE with a single channel of multiplicative noise is considered 
in the form of dXt = AXfdt + BXfdWt given the initial condition that X{Q) = xq 
with probability (w.p.) 1, where W is the one dimensional Wiener process such that 
Jq dWt ~ iV(0, s), i.e., is standard Gaussian distributed with mean and variance s. 
In our definition of the stochastic logarithmic norm we shall use the the matrix p-norm 
induced by the vector p-norm and the expectation of the ^-th raw moment, i.e., the Z-th 
mean of the solution to the linear multiplicative SDE. The stochastic logarithmic norm 
is computed over the sample paths as the expected logarithmic norm of the system in 
the sense of the existence of a generalized derivative of the Wiener process which itself 
is not obligatory differentiable with respect to time. 

Throughout the paper the following standard assumptions are made as in [9] . Let there 
be a common probability space {fl,A, P) with index t e T C K on which the stochastic 
process X{t) is a collection of random variables. The Wiener process W = {Wt, t > to} 
is associated with an increasing family of cr- algebras {At, t > tg}. For the general case of 
multi-dimensional noise, each component of {Wj^*''} is ^(-measurable with E(VF(to)) = 



w.p. 1, E{W{t)\Ato) = 0, E((W(<') - VFi'))(VF/^') - wP)\As) = S,,j{t~s) for h < s < t 



and AW = W{tn+i) — W{tn), the component wise increments of the multi-dimensional 
Wiener process, are independent of each other at all points in the partition of the time 
interval T: to < ti < t2 ■ ■ ■ < tr < tr+i < . . . < In = tf . The initial value Xq is assumed 
to be -measurable with ||^o||p < oo w.p. 1. All expectations on a function 0(Xt) are 
evaluated as E{(j){Xt)\At) unless otherwise stated. Inequalities and equalities involving 
random variables hold almost surely where applicable. 

The stability analysis in [17] uses test equations with scalar and 2-by-2 matrix coef- 
ficients having multiplicative noise of dimension one [16] . Some of the analysis uses the 
classical logarithmic norm to establish the stability of the moment equations (derived 
from the SDE) which are deterministic. The present approach with stochastic logarith- 
mic norm generalizes the stability analysis of SDEs as found in [16,17]. 

1.1. Classical Logarithmic Norm 

For 1 < p < oo, the p-norm on C" is given by 




i/p 



for 1 < p < oo, 



max |a;,-|, 
I i<j<« 



for p = oo. 
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Obviously, ||a;||2 :~ (x^x)^/'^ is the 2-norm on C". For A e C"^", the spectrum A{A) 
of A is given by A{A) := {A G C : rank(A — XI) < n}. We denote a matrix p-norm on 
i^nxn induced by the vector p-norm as || • ||p for p = 1, 2, oo and define these norms as 
IIAII2 := maxjI^A; : A^- G A{AA")}, \\A\\i := Taa.Xj=i....,n {T,7=i l^tjl) andP||oc^ := 

Then the logarithmic norm for a single matrix is defined as 



(e;=i k 



\\I + hA\\,-l 

'■=,!^. — h — ■ 



For the 1,2 and 00-norms, the classical logarithmic norms, respectively, are computed 
([5],Vol 1) as ^,^iA) := max, (5R(a,, ) + EJ^, K\) , /.2(A) := ^"^ax(A + A^) 
l-iooiA) maxi (^^{au) + Y.7^j l«y l)- 



and as 



1.2. Stability of the SDE 



The stability of the vector SDE with single channel multiplicative noise is defined as 
follows. 

Definition 1 [2,3] The equilibrium solution Xt = to dXt = AXfdt + BXtdWt is 
stochastically stable in the l-th mean (I is a finite integer > 1) using a vector p-norm if 
Ve > 0, 35 > such that 

E(||X(t)||^) < e yt>to and \\X{to)\\p < 6 w.p. 1 (1) 

and is asymptotically stable in l-th mean if in addition, BSq > such that 

lim E(||Xt||') = y\\X{to)\\p<Sow.p.l. (2) 



2. Background 



In the following items we review the existing stability analysis of linear stochastic 
differential equations with multiplicative noise. 

(a) In [16] scalar stochastic differential equations of the form dXt = XXtdt + (3XtdWt with 
Xq = I w.p. 1, where A and /3 are constants have been considered and it is shown that 
the above stochastic differential equation is mean square stable using the 2-norm if 
23?(A) + < when A,/3 are complex scalars. 

(b) In [17] vector stochastic differential equations, with single channel multiplicative noise, 

of the form dXt = DXtdt + BXtdWt, where D = ( M and B = f 

V ^^2 / \ P2 ^2 / 

have been analyzed for mean square stability. It is shown that the above stochastic dif- 
ferential equation is mean square stable in the ao norm if max{2Ai-|-(|ai|-|-|/3i|)^, 2A2-I- 

(|«2| + |/32|)n<0. 

(61) In [16] for the same stochastic differential equation as in (a) the Mil'stein scheme 

[11] Xn+i = Xn + XXnh + ^iX^AW + ^^'^/"^ with 0{h^-^) root mean square 
error is analyzed for stability in the mean square sense. The mean square stability 
function R(h) = |1 + /iA|^ + + ^Ih"^ ^''l is derived and it is shown that the SDE 
is stochastically asymptotically stable in the mean square when R{h) < 1. 
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(&2) The reference [16] also considered the SDE as given in (b) and applied the Euler- 
Maruyama numerical integration scheme as Xn+i = Xn + hDXn + BXn^W, where 
h and AW stand for step-size and the increment of the Wiener process, respectively. 
Then the discretized SDE is shown to be stochastically asymptotically stable if 

max{(l + X,hf + (|ai| + \(3i\f, (1 + X2hf + (jaal + \P2\f} < 1. 

Next we briefly review a few essential aspects of the logarithmic norm that are used 
in the stability analysis of ODEs. 

(c) In [4.10] the logarithmic norm was introduced in order to derive error bounds for the 
solution of initial value ODE problems using differential inequalities that distinguish 
between forward and reverse time integration. This led to requirements for the stability 
of initial value and boundary value ODE problems. The classical analysis, using the 
vector norm || • || on C" and the sub-ordinate matrix norm on C"'^", defined the 
logarithmic norm of a matrix A as 

y \\I + hA\\p-l 
lipiA) := hm . 

(d) More recently Soderhnd [20] considered f : D d X —f X and defined least upper 
bounds (lub) and greatest lower bounds (gib) Lipschitz constants by 

f{u) - f{v) . , I{u) - fjv) 
i[/J = sup — ■ ■ — , /[/] = ml — ■ ■ — , 

u^v \U~V\ u^v \u-v\ 

for u and v € D, where the domain is path connected and 

l[f]\u-v\<\fiu)^f{v)\<L[f]\u-v\. 

If /[/] > 0, then f{u) — > f{v) implies that u v. Then / is an injection, with an 
inverse on f{D), the same as a matrix A G C"^" being invertible if its gib is strictly 
positive. Also then, L[f~^ = l[f~^], where L[f~^] is defined over f{D). If / = A is 
a linear map then L[A] = \\A\\. Hence L[.] is left and right G-differentiable for the 
class of Lipschitz maps. This allows one to define the lub and gib logarithmic Lipschitz 
constant, by 

Mlf} r L[I + hf]~l L[I + hf]-l 

M[f]= hm ,m[f]= hm . 

h^o+ h h~>o- h 

The lub logarithmic Lipschitz generalizes the classical logarithmic norm for every ma- 
trix A, so that, M[A] = ^{A). 
In the following section we develop the stochastic logarithmic norm as an upper bound 
estimate of the rate of growth of the solution of a multiplicative noise linear SDE. The 
rate of growth is analyzed as a Dini derivative of the Z-th mean in vector p-norm of 
the solution. This approach may be seen as a special case of the modern definition of 
logarithmic norm in [20] and as an extension of the classical definition as in [4,10,19]. 
Other works [8] deal with logarithmic norm of matrix pencils with one invertible matrix. 
However in our current treatment we do not use matrix pencils for defining the stochastic 
logarithmic norm. 
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3. Definition of the Stochastic Logarithmic Norm 



A linear Ito SDE with a single channel of multiplicative noise is written as 

dXt = AXtdt + BXtdWt, (3) 

where A,B£ C"^", are constant matrices. For the non-linear Ito SDE with a single 
channel multiplicative noise given by 

dXt^ fiX,t)dt + g{X,t)dWt, (4) 

the strong order 1.0 Ito- Taylor expansion (Mil'stein scheme when used in numerical 
integration) of Xt at t = tn-i-i is given as 

Xn+i=Xn + fiX^,t^)h + giXn,t^)AW+(g^) + i?, (5) 



dx 



(x„,t„) 



where h = tn+i ~ t„ is the step-size, W{tn+i) — W{tn) —'■ AW ~ ^(0, h) and R are the 
0{h^^^) remainder terms in the root mean square sense. When linearized a.t t = tn, A := 

(fx) ^^'^ ^ (if) • shall define the stochastic logarithmic norm by studying 
the growth of the l-th. mean of the solution X of the linear SDE (3) (linearized SDE in 
case of SDE (4)) w. r. t. time. We seek an upper bound for the growth rate of E(||X||p) 
using the upper-right Dini derivative which for any function S(t) w.r.t t is defined as 

The strong order 1.0 Ito- Taylor expansion (linearized at t in case of the non- linear 
SDE (4)) applied to Xt over the time interval [t, t + h] gives 

X{t + h) = X{t) + hAX{t) + AWBX{t) + C'^^)^ - ^ B^X{t) + R, (7) 

with the remainder terms R being 0{h^'^) in the root mean square sense. In the above 
expansion (7) AW := {AW{t), t > 0} are the independent increments of a Wiener process 
over the interval [t, t + h]. Taking the p-norms and raising both sides of (7) to the power 
of ^, we can write the following inequality: 

\\X{t + h)\\l <\\I + hA + AWB + i^Wf-^ B^ + RX\\X{t%, (8) 

where Rx are root mean square 0{h^'^) remainder terms. For the /-th mean using a p- 
norm, we apply expectation to both sides of the above inequality and get. almost surely 
(a.s.), 

n\x{t + hx < E (^11/ + hA + AWB + (A^l^B^ + rx) nxmp- (9) 

observing that X{t) is independent of the Wiener increment AW since the Wiener process 
is a non-anticipative process. Then, we estimate the expected rate of growth as 

E(||/ + hA + AWB + (^wf-h B-^ + R\\\\ - 1 

E {D+wxm',) < in^^ — — mx{tX). 



Based on the limit term on the right hand side above we introduce the stochastic loga- 
rithmic norm. 

Definition 2 The stochastic logarithmic norm of a square matrix pair of same di- 
mensions, [A,B), in the l-th mean using a matrix p- norm is defined as 

.1 iA, B) ^ ^ (10) 

where the limit is taken in the sense of the existence of the generalized derivative of the 
Wiener process and ||^||p, \\B\\p are assumed to he finite. 

From the above definition the expected rate of growth of the solution can be estimated 
as 'E^{D+\\X{t)\\l) < vl{A,B)'E{\\X{t)\\\,) since are of root mean square 0{h^-^). 
Obviously the weaker estimate 

D+E\\XitX<i.l{A,B)mXit)\\l) 

also holds so that E||X(t)||^ < e''^(^'-^^*||X(to)||p for the linear SDE (3). The linear 
SDE (3) is stochastically stable in the l-th mean using a p-norm when i/^ {A, B) < 
and is asymptotically stable in the l-th mean using a p-norm when {A, B) < 0. The 
linearized SDE (4) (and hence the linear SDE (3)) is numerically stochastically stable in 
the l-th mean using the p-norm if < since over fc (fc <C oo) time steps each of size 

sufficiently smaU hi > almost surely we have E||Xi+fc;i||p < e^i=^'^''^^"^'^^'E\\Xt\\p 
when each i/p{Ai,Bi) < 0. If Ej|Xt||p is finitely bounded w.p. 1, then E||Xt+fc;i||p is 
almost surely finitely bounded. Later in the paper we relate the stochastic logarithmic 
norm to the pseudospectrum of the Ito stability matrix A — ^B^ for the linear SDEs with 
multiplicative noise. 

It may be remarked that for an SDE with additive noise and for an ODE, the stochastic 
logarithmic norm is given as i^p{A,0) = iJ.p{A). 

4. Some Estimates of the Stochastic Logarithmic Norm 

In this section we derive some estimates of the stochastic logarithmic norm using 
the matrix p-norm, where p ~ l,2,oo. The estimates show the incremental behavior of 
the stochastic logarithmic norm under perturbations and also the effect of noise on the 
deterministic ODE. 

Let A,„ax(^) be the largest eigenvalue of any square matrix A. We state the following 
Lemma from pp.62, [1] which we shall use in estimating the stochastic logarithmic norm 
while using the matrix 2-norm. 

Lemma 1 Let A,B ^ i^n-Kn Hermitian matrices. Then 

Amax(^) + Kmn{B) < Aniax(^ + B) < A,„ax(^) + A,„ax(S). 

The equality holds when B = fc/, where k is a scalar constant and I is an identity matrix. 
For the matrix 2-norm and in the mean we can estimate the following from (10). 
Theorem 5 The stochastic logarithmic norm in the V"^ mean, where \ < I < oo using 
the matrix 2-norm satisfies the following bounds in the sense of existence of a generalized 
derivative for the Wiener process as Qdt — dWt, C N{0, 1). 
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B) < ^A„iax(A + A") + ^ (An.ax(S + B" ) + A,„ax(-B - B" )) 

+ ^A„,ax(B^i3) + t^ALx(S + B''), ^>2, (11) 

4{A, B) < ^A„,ax(^ + + l (Vax(S + B") + A„ax(-B - B")) 

+ ^-XmUB"B), I < 2, (12) 

ui{A, I) = iA^ax(A + ^^) + ^ + (13) 

where A, B R"^" are f/ie (linearized) drift and diffusion coefficient matrices in a vector 
SDE with a single channel of Wiener process noise. 
Proof: For 1 < Z < oo we have from (10) 



4 (A, B) = lim 



E(||/ + feA + AVKg+ '^' g^ll^) -1 



E ( W An,ax ((/ + + ^WB + (AW2^-fe g2)g(J + + A14^B + (AHg!^52) 



lim - 

Then we may write 

(/ + + Aw/s + + + Aiys + mi^s^) 

= (/ + /lA^ + AW^B^ + (^^)'-^ (j3g)2)(^ ^ ^ ^ (AVK)^-fe ^,^ ^ 

/ + /lA + AT^B + I^El!_Z!:s2 ^ _^ AM^s^ + [I\wYb"b 

^ {im^f^h){B^Y +... = / + + A«) + AVl^(i? + S^) + (AVl^)2i3^i? + 

^^^^B^^i^B-f)^:.. 

It is possible to write C = /i(A + ^^) + AM^(B + B^) + (AVF)^^^^ + (^^^)'-'' (^2 
[B^Y) ^ series in the normalized time step size /i ^ 1. We use the identities 
Amax(c^) = |c|Aniax(sign(c)A) (where c is a constant, sign(c) = — , z ^ 0) and }^^^^J^A) = 

Amax(^^) for estimating the terms in the series. Using the triangle inequality and the 
identity [A,„ax(-f + C')]^ = (1 + Amax(C')) 2 , the following can be written: 

(1 + A,„ax(C))^ = 1 + ^A,„ax(C) + ^^^-^A„,ax(C)2 + . . . = 1 + 

^A,„ax {kA + A^) + ISW{B + B^) + {ISWfB^B + ^-^^1-^{B^ + {B^f)\ 
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^^^A„,a. (^h{A + A") + AW{B + B") + [m^fB^B + (^^)' ^ (^2 ^ (5^)2^^ 
+ • • • < 1 + \^h\^^^{A + A^) + ^A,nax(AM^(B + 5'')) + ^(AM/)2A,„ax(S^S) 

+ {{^Wf ~ h)Lx^UB' + iB"f) + (AWflil-^Xl^^iB + B") + ---. (14) 

The equality holds when B = I and follows from Lemma 1. Taking expectation on both 
sides and in the sense of generalized derivative of the Wiener process which is the Gaus- 
sian white noise C we have E(A,nax(/+C))^ = E(l + Amax(C))5 < l + |/lA,nax(^ + A^) + 
E(|CI)/i3(Amax(S + B") + A„,ax(-i? - B")) + Ei{AW)^) ^X.-^^B" B) + (E((AM^)2) - 
M3An.ax(S' + (S^)')+E((AM^)2)^ALx(S + S'') + 0(/^i-5) = l + /i|A,„ax(A+A«) + 

hi{X^,^{B + B") + X^,^i~B~B")) + ihX^,^iB"B)-h'-^Xl^^{B + B") + Oih^''). 
For ft, — > 0''" we obtain 

lim E(An.ax(l + C))^~l ^ l^^^^^^ ^ ^H) ^ ^A,„ax(S + B") + A,„ax(-i? - B^)) 

h^o+ h 2 ' 4 ^ ^ 

+ '^Xm.AB"B) + i^l^ALx(B + B"). 
(6) When B = I, we have 

lim E(A^ax(/ + C))i-1 ^ l^^^^^^ ^ ^ U^UB"B) + 

?(/-2) 2 ^ 

^ KiaAB + B ) 

vi{A, B) = ^A„,ax(A + A") + l+ 11_Am 



Corollary 1 For a positive integer I > 2, 

vi{A,B) < I (^f,2{A) + ^\\B\\l + i(M2(S) + t^2{-B)) + ) (15) 

For I < 2, 



4iA,B) < I (^^i2{A) + ^{p2{B) + ^P2{-B)) + ^\\B\\ij 



(16) 



Proof: The results (15) and (16) follow directly from (14) in Theorem 5 by Lemma 1 
and the Ito isometry for the expectation of the Ito integrals. ■ 
The inequality (15) has been used for mean square stability estimates in [17]. 
Corollary 2 If I = 1,2 and p = 2, that is, in the mean and in the mean square and 
using the matrix two norm, the following results hold when B is the identity matrix I . 
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Ua n ^ (A + AH\ 1 4 ^ (A + A"\ 
vl{AJ) = A„,ax ( ^ j + 2^8" i 2 ) " ^ ^ 

/) = A,„ax (A + A^) + 1 = 2Ai2(A) + 1, (18) 

Proof: The results follow from Theorem 5, by substituting p = 2, Z = 1 and p = 2,1 = 2M 
Some properties of the stochastic logarithmic norm under perturbation is obtained in 
the following result. In the generalized sense of the Wiener process derivative a couple 
of useful inequalities showing how the Wiener process perturbs the deterministic ODE is 
also given. 

Theorem 6 For any square matrices of same dimensions, B, A, AA, AB and a real 
number a > the stochastic logarithmic norm has the following properties. 

v'p{aA,y/7iB)^av'p{A,B) (19) 

{A + AA,B + AB) < vl [A, V2B) + vl ( AA, ^/IAB) ^ ^\\{B - ABf\\^ (20) 

v2 

v'^{A + AA, B + AB) < ul{A, —^) + ^^(AA, —^) (21) 

^^(A,0) = ?Mp(A) (22) 

Further, in the sense of the existence of a generalized derivative of the Wiener process 
which is a Gaussian white noise, the following estimate holds for a positive integer I and 
for any of the matrix p-norms. 

^^(A, B) < It^M) + ^n,{-B') + ^-^^\\B\\l + l\\B\\, (23) 
< l„,iA) + l\\B\\, (^1 + ^lisilp) < l^iM) + ^ (l + (24) 

Proof: We can scale the Wiener process as y/a and write 



v\(a.A,\fa.B)= lim a 



E ( 11/ + {ah)A + A{^W)B + (AV^vv) -"''^ 2||A _ ^ 



= ai'p(A, B) 

for any positive integer I and any of the matrix p-norms. 

From the definition of the stochastic logarithmic norm and scaling the Wiener process, 
we can write 

E(j|/ + {2h)AA + {V2AW){V2AB) + ^^^^^^—^{^AB)^\\p) - 1 
^ 2h ^ 

E| lo WudWul ^^BAB+ABB-B^-(AB)^\\p^ < iyl{A,V2B)+i,l{AA,V2AB) + ^\\{B-AB)^\\j, 
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E| f' W^dW^\ I, I- . 1 

since lini/i_>o+ — ° ^ = h/{\/2h) ~ For any positive integer I, the above can 

be re-written as 

+ AA,B + AS)< lim 2'-i-^E||/+(2;i)A+(x/2AVK)(V2^^ ) 

(AV2M^)2 - 2/i , r-B + AB 



2 



(V2^±^rilt-l)/(2M 



1 P I A P 

2'-i^E||/ + {2h)AA + {V2AW){V2—^ ] 

{AV2W)^ -2h. r-B + AB 



iV2^^)X-l)/i2h)'^ 



2 

^ I, ^ B + AB^ ; ,^ ^ B + AB. 
- ' ~V2~^ ^ ' ~V2~^- 

Applying (20) recursively to 1^^(^1 + 0,5/2 + 5/2) and using (19), we obtain i^piA, B) < 
lim„^oo(^^^(A, j^B) + (2" - 1)^.^(0, j^B)) = i.^(A,0) +lim„^^(2V2")i'^(0,i?) + 

= i/^(A, 0) + 1/^(0, B). For I = 1, the inequality reduces to i^^{A, B) < ^ip{A) + 1^^{0, B). 
For the deterministic case with no noise, we have 

v'p{A,Q)^ hm 

- lim l\\I + hAg-^D+,h\\I + hA\\p 

= lim l\\l±l3z^ 
^l^lp{A). 

For the stochastic logarithmic norm of the diffusion coefficient B it is possible to write 



^-'(0,5)= lim 




in the sense of the existence of a generalized derivative of the Wiener process so that 
/o idt = /o dWs where £, - 7V(0, 1) is a Gaussian white noise. Further we 
= |/ip(— B^) and ||yUp(— i3^)| < from the properties of the logarithmic norm [5]. 

Hence the estimates (23) and (24) . ■ 

We remark that the stochastic logarithmic norm does not satisfy the triangle inequality 
property nor the that of the multiplication by a scalar in the same way as the (determin- 
istic) logarithmic norm. However, it is consistent with Ito calculus in its property (19) of 
multiplication with a scalar. Again, Ito calculus makes the noise "redistribute" for any 
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additive perturbation to the drift and diffusion coefficients as found in (21). 

The logarithmic norm coincides with tlie stochastic logarithmic norm in special cases. 
One such case is obtained from Theorem 5 by setting I — 1 and B ~ I (and also by 
setting i? = in the trivial case) for p ~2. 

Theorem 7 max^ 3?(A(yl)) < ii^|(A,/) — i where I is the identity matrix. 

Proof: From (18) we have :^|(A, /) = 2/i2(A) + 1. The logarithmic norm has the lower 

bound property [5]: nia.x\^{X{A)) < fJ.2{A). Hence the inequahty. ■ 



8. Conditions for Mean and Mean Square Stability 



We recall that the linear SDE (3) is stochastically stable in the Z-th mean using a 
p-norm if i'p{A, B) < 0. To estimate of the stability of a linear SDE one of the upper 
bounds derived in the last section may be used, especially, when it is needed to compute 
incrementally the effect of adding noise to an ODE or an SDE with known stability 
estimates. In practice, when using the upper bounds for estimating the stability of an 
SDE incrementally, a small positive number (determined by the stochastic stability region 
of the numerical integrator) is used as cut-off rather than a very small tolerance or zero 
so that the effect of non-normality and stiffness [6] in the SDE's (both linear and locally 
linearized) transient numerical behavior in the stochastic logarithmic norm is taken into 
account. 

The following results are a couple of special cases of the stochastic logarithmic norm 
approach to the stability of SDEs with multiplicative noise. 

- We consider the scalar case A = a £ C and i? = /3 G C in (3) . Then we apply Theorem 
5(a) and consider (15) for I = 1,2 the condition i/!p{A,B) < 0, so that for p = 2, we 
get the condition for stochastic stability in the mean as 



1, 



f < 

and in the mean square as 



(25) 



25R(a) + |/3|2 <0. 



(26) 



The above conditions are essentially the same but in practice the on the right hand 
side is replaced by TOL which is a small positive real number [13] and thus I becomes 
significant for estimates in higher moments. These results are the same as in review 
(a) of Section 2. 

X2 J \P2 a2 

stable in the cx)-norm if 



For the matrices A = 



the SDE (3) is mean square 



2max{Ai,A2} + 2 (^-max{|ai| + |/3i|,|a2| + l/Szl} 
The above condition is obtained using (24) in which 



1 < 0. 



(27) 



:/4(A,0)= hm 



(max{|l + /iAi|,|l + /iA2|})^-l 
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= lim 2 maxill + /iAi|, |1 + /1A2I} max{Ai, A2} 
= 2 max Xi 

1=1,2 



and \\B\\^ = max{|ai| + jasl + \p2\}. 



9. Direct Computation of the Stochastic Logarithmic Norm and Sharper 
Bounds 

Theorem 10 In the sense of the existence of a generalized derivative for the Wiener 
process, i.e., C,dt = dWt, C ^ -^(0,1), we can compute the stochastic logarithmic norm 
directly as follows. 

1 



Proof: 



E||/ + hA - \B^h + BAW + \B^{AW) 



.^(A, B) = lim ' '^'^ ^" ' "7" ' ^" ^""^ 

= lim E( + i52^^^N2|ji-i 

xD+j,\\I + HA - ^B^h + BAW + ^B^{AWf\\p 



j.^ E||/ + (A - ^B')e + Bj; Cds + ^B^ (/J (dsf \\ - 1 
€-»o+ e 

= /e(^Mp (^^-is^^Sc)) , (28) 

where the last equality follows from considering the Ito formula along with the generalized 
derivative of the Wiener process. ■ 

The above result shows that the stochastic logarithmic norm is the expected logarith- 
mic norm behavior of the SDE. Consequently we can derive the following inequalities. 

Corollary 3 

i^liA, B) < IfipiA) + I {ii.p{-B^) + ^ip{B) + Mp(-S)) (29) 
v^iA, B) > liip{A) - L (/,p(s2) + ^^(5) + ^p(-B)) (30) 

Proof: From (28) we have B) < lfip{A) + | {fip{-B^) + E{^ip{BQ)) in view of the 

triangular inequality of the logarithmic norm. Since ( ~ ^^(0, 1), we have E(/Zp(-BC)) = 
E|C|(Mp(S) + fip{-B))/2 = (^p(B) + fipi-B)) 12. Again, Mp(A) = ^p(A - + + 
- BQ < ^lpiA - \B^ + BQ) + fipi^B^) + ^^^(-^0 so that l^ipiA) - liJLp{\B^) - 
lEfip{—B(^) < i'!p{A,B). Hence the inequalities. ■ 

Corollary 4 The stochastic logarithmic norm can be bounded as follows. 
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-/E|/ip(BC)l <l 



2 



-l\\B\\ 



E{fip{A~-B' + BC 



From the triangular inequality we have 



^lp[A-^B^+ BC 



< 



Mp I ^ - 



and the bound property of the logarithmic norm leads to 



\uLiA,B)\<l 



A--B^ 
2 



-'E||i?ciip<; 



Imp(sC)I 



(31) 



Proof: By Theorem 10 we have ^piA, B)\ = I \^ {^ip {A - ^B'^ + BC))\. Then, by 
Jensen inequality one obtains, a.s.. 



A--B^ 
2 



IWBW 



11. Examples 

11.1. Stabilization of an inverted pendulum 

It is well known [18,14] that a vertical inverted pendulum can be stabilized around 
a mean vertical position by application of a suitable highly oscillatory excitation in the 
form of an appropriate noise. We compute the stochastic logarithmic norm of such a 
system to show how an appropriate noise stabilizes the system. The equation of the 
inverted pendulum may be written as 



de^ 

dv - 



-V dt + ev dWt, 1 > e > 



e dt + he dWt, 



(32) 
(33) 



where g is acceleration due to gravity, Z > is the effective length of the pendulum 
and 9 is the small angular displacement from the mean verticalposition, i.e, = 0, so 

^ ^ ' " ^ It may be noted that H2{A) = ^ 



that A = 



f 



and B = 



b 



2 . f and 



3fiAinax(^) = f > 0. Thus the system without the Wiener process excitation is unstable. 
The stochastic logarithmic norm of the Wiener process excited system may be computed 
as 

i/|(A,B) = E(max{l + I + (6 + e)C-6e,- (l + y + (6 + e)C + 6e)}) , 

where C ^ N{0, 1). For stabilizing the pendulum around the mean position 6 = we 
require I'KA, B) < and get the condition that 



6> i (1 



(34) 



in which e/{2(l+g/l)) can be interpreted physically as the amplitude of a very wide band 
vertical excitation (as an approximation to Wiener process) at the base of the pendulum. 
Since a Karhunen-Loeve expansion of the Wiener process [9] contains the high frequency 
terms, this also shows how the above result is consistent with the result (in [14]) that 
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a small amplitude highly oscillatory wide band vertical excitation stabilizes a vertical 
inverted pendulum. 



11.2. Nonnormality 

From [7] we take this linear SDE in the form of (3) in which A := ( ^ ] ,B 

a 

-a 



X -1 

6 G R. Obviously the system without any Wiener process excitation, i.e, 



the deterministic ODE is asymptotically stable but ^l2{A) ~ niax{| — 1,— (| + l)} due 
to non-normality of A and the ODE system tends to be numerically unstable in its 
transient behavior when |6| > 2. Formulating the system as a multiplicative noise SDE 
we compute the stochastic logarithmic norm directly from (28) in the mean square and 
using the 2-norm as in [7]: 

i/| = max{(T^ - 2 ± 6} 

whence it is required that < min{2=Ffo} so that < for the mean square stability of 
the SDE. If (T e M and |&| > 2. then it is not possible to numerically stabilize the SDE in 
the mean square by choosing an appropriate a. For |6| > 2 and cr G C, cr^ < 2 — |5| would 
be sufficient for exploiting the noise towards numerically stabilizing the SDE system in 
the mean square. If cr, 6 G M and a := , then the SDE system is stochastically stable 
when 1 > 6 > 

11.3. Numerical examples 

Example 1 We consider 

-100 \ ^ /5 



-200j'^=V0 6 
^''> 200 -200 )' [o 6 

^=(, -200j'^=(,0 6 

. _ /-100 + 20Z \ „_ f5 + i 
^"^'^-y 2 -200 + ^j 1^ 2i -6-lOz 

, , . ?-100 20 \ „ fb 2 

^=1, 7 -200j'^=(,4 6 
(/) A = -100,5 = 10 ([16]). 

t)^^-(o t)"""-^'- 

-0.2 3 100 \ /2 30 10 

-0.2 50 ,Si := 2 50 

-0.2/ \0 2 

' 2.2857 X 10-2 -2.3547 x 10"^ -6.8279 x 10 

Ai2 = I 9.3914 X 10^2 _9.67i9 x 10-^ -2.8049 x 10 

2.8585 X 10-1 -2.9443 x lO^^ -8.5382 x 10 
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/ 1.2606 X 10-1 -4.6007 x IQ-^ 7.0963 x lO^^ \ 
and Bi2 1.8156 x lO'^ -6.6259 x 10"! 1.0235 x 10"^ 
\1.4481 xl0-i -5.2845 x 10-1 8.1625 xlO^^y 
(h) yl= lOOx Ciooxioo,S- lOOx i^iooxioo; C„ , A,— C/(0, 1). 



Example 


Lbound 


4iA,B) 


Ubound 


(a) 


-1.1239 X 10^ 


-1.0470 X 10^ 


-4.0393 X 10^ 


(b) 


-1.1919 X 10^ 


-1.1468 X 10^ 


-3.1393 X 10^ 


(c) 


-2.4082 X 10^ 


-2.2415 X 10^ 


-1.5302 X 10^ 


(d) 


-2.2490 X 10^ 


-2.2354 X 10^ 


-5.9075 X 10^ 


(e) 


-2.6837 X 102 


-2.3232 X 10^ 


-1.21915 X 10^ 


(/) 


-3.0000 X 102 


-3.0026 X 10^ 


-1.0000 X 10^ 


(5) 


-9.1852 X 10^ 


9.2453 X 10^ 


4.8398 X 10^ 


{h) 


-2.5191 X 10^ 


1.2369 X 10^ 


2.5330 X 10^ 


(0 


-6.0000 


-5.91409 


-2.0000 



Table 1 

The table gives values i/|(A, _B) and compares them with the estimates Ubound and Lbound. 

In Table 1 Ubound is computed using the right hand side in (29) with p = 2, 1 = 2 and 
Lbound is computed using the right hand side in (30). The stochastic logarithmic norm 
is computed using (28). 



12. Extension to Multiple Noise Channels 

The definition of the stochastic logarithmic norm can be extended to the vector SDE 
with multiple channels of multiplicative noise (i.e., with multi-dimensional Wiener pro- 
cess). Considering the Ito- Taylor strong order 1.0 (Mil'stein) scheme for the SDE 

m 

dXt = AXtdt + J2 B^^'^Xtdwi^^ , (35) 

where each W^^^ is an independent component Wiener process, we can define the follow- 
ing. 

Definition 3 The stochastic logarithmic norm for a tuple ofm + 1 square matrices 
of same dimensions, {A, B^^\ B^^\ • • • , S'"'^), i.e., (A, B^i'™'), which are the (linearized) 
drift and diffusion coefficients of a (non-linear) vector SDE with m channels of multi- 
plicative noise, is defined as 



15 



1(a.B('-"'A = lim '-^ 

/ /i— 0+ h 

where the limit is taken in the sense of the existence of the generalized derivative of the 
Wiener process and \\A\\p and each ||_B^'^||p are assumed to be finite. 
For p = 2, Z > 2 it is easy to obtain the following estimate after proceeding as in the 
estimate in (15). 



3 = 1 



+ L f](^,(i3W) + M2(-i?(^-))) + f:(A^2(S«))^ (36) 

j=i i=i 

In general, for any p, it is possible to estimate i'p(0, i?*^^'™^) in the sense of the exis- 
tence of a generalized derivative of the Wiener process such that dW'^'^ = C'^'Ut, C^*' 
iV(0, 1), E(C(*)C^J)) = for i 7^ j: 

ni + Er=i B(^)AW^^^ + E E^^''^'"' Jo lo dwi''>dWs^''^\\'p - 1 
z.'(0,S(i^")) = lim ^i^^i 

h^0+ h 

rn 

>2 



i=l 

h'^a+ V (2ft.) 



< lim ( ^^-7^ + 



m m 



m rii 



<^M.(-E^^') + 'Eii^''ii. + ^Eii^'^iip + 75E E ii^'^^^^^'^i 
i=i i=i 1=1 1=1 j=i, -t^j 

Then we can upper bound the stochastic logarithmic norm as 



, m rn , m 

r^liA, B^'--^)) < l^^,{A) - ^Mp(E B^'^) + ' E 11^*^' lip + ^ E 11^^'^ lip 



i—1 i—1 i—1 

4|E E ii^^'^^'^'^iip- (37) 

Similar to (28) we can compute the stochastic logarithmic norm for the multi-channel 
case with 

uliA, 5(1^™)) = IE (^^,, - ^ E + E ^^^'C*'^) ) ' (38) 
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and bound it as in (31) as 



< I 



^ Til 



(39) 



From (38) and as in Corollary 3, the stochastic logarithmic norm for the multiplicative 
multiple channel noise can be bounded as 

, rn 



i=i 



< lfi,{A) + - E Ui'B^'^') + A*P(S('') + Mp(-S 



(40) 



13. Relationship with Pseudospectrum 

We have mentioned in the introduction that the logarithmic norm as a bound on the 
pseudospectrum of the stability matrix provides an estimate of the finite time interval 
numerical stability of an ODE. The finite time interval numerical stability differs from 
the asymptotic stability in capturing the effect of nonnormality of the stability matrices 
and local stiffness that affect the computation of the numerical integration. In SDEs 
with multiplicative noise the diffusion coefficients may significantly affect this transient 
numerical stability of an SDE. It may be recalled that balanced methods have been 
designed [12] to overcome difficulties arising from stiffness in both drift and diffusion. The 
stochastic logarithmic norm relates to the pseudospectrum of the drift coefficients by way 
of diffusion coefficients acting as perturbations and thus captures the expected transient 
stability of the SDE. The estimate of stability based on the stochastic logarithmic norm 
can then be used for selecting an appropriate stiff stochastic integrator. 

Let II — I X^Zli -^(*^ + X^i^li ^^*^C'*'I|2 = P- From the definition of pseudospectrum 
[15], we may write: 

rn m \ 

1=1 1=1 / 

m m \ \ 

^-^E^^'^'+E^'^c'^Mj 



< E ^2 



(41) 



using (38). For small noise with 1 ^ /3 > 0, obviously, the stochastic logarithmic norm 
gives an upper bound estimate of the mean transient numerical stability behavior of the 
deterministic ODE dXt = AXtdt. Denoting 7 = || X]"ii ^('■'C''*''l|2, and proceeding in a 
similar fashion as in (41) one obtains 

E maxSRA, [a-\Y^ B^^^'^ < E (^/.^ (^^ - i E + E ^'^^^'^ ) 
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(42) 



In the above inequalities the stochastic logarithmic norm appears as an upper bound on 
the mean maximum real part of the perturbed spectrum of A — ^ Sl^i ^^'^ which is 
significant for the stochastic asymptotic stability of the SDE (35). 

14. Conclusion 

This paper has extended the classical logarithmic norm to define the stochastic loga- 
rithmic norm for the numerical stability analysis of vector Ito stochastic differential equa- 
tions with multi-dimensional multiplicative noise. Incremental estimates of the stochastic 
logarithmic norm due to perturbations and bounds with respect to logarithmic norm of 
the drift and diffusion coefficient matrices have been studied. Further investigation relat- 
ing the stochastic logarithmic norm to the pseudo-spectrum and stiffness, both in drift 
and diffusion, is needed since the stochastic logarithmic norm gives an upper bound on 
the mean maximum real part of the pseudospectrum of a matrix perturbed by the noise. 
This last property may be used in choosing stiff and balanced numerical integrators and 
a detailed study for various class of integrators in this respect remains to be done. De- 
tailed study of application of the stochastic logarithmic norm to the stability analysis of 
non-linear SDE is necessary too. 
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